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EXECUTIVE SUMMARY 
Office of the Inspector General 


Review of Audit Division’s Complaint, Form 1.28, Investigations Phase 2 Audit 


(Fiscal Year 2004/2005) 


OVERVIEW OF AUDIT DIVISION’S AUDIT 


Audit Division (AD) sampled 53 complaint investigations (33 investigated by Internal Affairs 
Group [IAG] and 20 investigated by the involved officers’ Chain of Command [COC]). Based on 
an in-depth evaluation, AD reported compliance percentages of at least 95 percent for the following 
Consent Decree (CD) paragraphs (fs) and subparagraphs:' 





g 


SUBJ ECT & COMPLIANCE PERCENTAGE 





CONDUCT OF INVESTIGATIONS 





TAPE RECORDED INTERVIEWS (97°) 





CONVENIENCE OF INTERVIEWS (100°) 





No Group INTERVIEWS (100% 





INTERVIEWS OF SUPERVISORS AT SCENE OF INCIDENT (100%) 





CANVASSING OF THE SCENE (96°) 





COLLECT AND PRESERVE EVIDENCE (97°) 





BURDEN OF EVIDENCE (100%) 





REASONABLE EFFORTS TO INVESTIGATE VUTHDRAWN AND ANONYMOUS COMPLAINTS (100%) 





COMPLETENESS OF THE INVESTIGATIVE FILE (100%) 





OVERALL ADEQUACY OF THE INVESTIGATION (100°) 





ADJ UDICATION OF INVESTIGATIONS 





VMITNESS CREDIBILITY ASSESSMENT (100°) 





No AUTOMATIC PREFERENCE OF OFFICER STATEMENTS (97°) 





No AUTOMATIC J UDGMENT OF INSUFFICIENT INFORMATION (100% 





PREPONDERANCE OF EVIDENCE USED TO AD UDICATE THE COMPLAINT (96%) 





AD) UDICATION OF ALL ALLEGATIONS (100%) 





MANAGERS EVALUATE COMPLAINT INVESTIGATIONS FOR UNDERLYING PROBLEMS AND TRAINING NEEDS (100°) 





PROPER NOTIFICATIONS TO THE COMPLAINANT (100° 





Slo] espere |S RRZeeesieg 


INITIATION OF A COMPLAINT FOR DISSUASION, FAILURE TO INFORM OR ACCEPT COMPLAINTS (100°) 
REFERRAL FOR CRIMINAL FILING WHEN CRIMINAL CONDUCT IS IDENTIFIED (100°) 


IDENTIFICATION &ADDRESSING OF MISCONDUCT 


OTHER 








NO INDICATIONS THAT THE COMPLAINANT VAS ASKED TO WAIVE HIS/HER RIGHT TO A LAWSUIT (100%) 





NOTIFICATION OF ACCUSED DEPARTMENT EMPLOYEE AND HIS/HER SUPERVISOR WHEN REQUIRED (98°) 








SBF 








ARTICULATION OF THE LEGAL BASIS FOR STOP (100%) 





Conversely, AD reported compliance percentages less than 95 percent for the following CD fs and 





























subparagraphs: 

C14 SUBJ ECT COMPLIANCE PERCENTAGE 
82 INITIATION OF COMPLAINT FOR ADDITIONAL MISCONDUCT 67/2 OF 3 INVESTIGATIONS) 
129c | GENERAL CONSISTENCY OF PARAPHRASED STATEMENTS 91% (42 OF 46 INVESTIGATIONS) 

80F(b) | ALL WITNESSES INTERVIEWED 887(43 OF 49 INVESTIGATIONS) 
84D NO INDICATIONS OF DISMISSAL OF WITNESS STATEMENTS SOLELY ON THE 98%(13 OF 14 INVESTIGATIONS) 

BASIS OF FAMILIAL OR SOCIAL RELATIONSHIP TO THE COMPLAINANT 
80G IDENTIFICATION OF INCONSISTENCIES IN OFFICER AND WITNESS STATEMENTS 9/P4(15 OF 16 INVESTIGATIONS) 








' Greater detail on AD’s methodology and findings can be found in their final audit report. 
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Executive Summary 
Review of AD’s Complaint, Form 1.28, Investigations Phase 2 Audit (Fiscal Year 2004/2005) 


1.0 


OVERVIEW OF OIG’S REVIEW 


Pursuant to CD { 135, the Office of the Inspector General (OIG) reviewed the completeness, 
findings and quality of AD’s audit. The review found that overall the audit was complete and that 
the findings were adequately supported and presented. However, regarding the audit’s quality, the 
OIG identified the following two significant issues: 


Audit Division used a sampling methodology that resulted in a relatively small sample of 
complaint investigations being evaluated. Specifically, AD reported that its sample was 
selected from a population of complaint investigations closed in August 2004. However, its 
sample was actually selected from a population of 113 complaint investigations that were 
completed from August 1 to 31 of 2004 and “closed” (fully adjudicated and entered into the 
Complaint Information System [CIS]) from August 1 to September 14 of 2004. The population 
included investigations from 17 commands; and AD’s sample included 20 COC investigations 
from only 12 commands. 


Based on a query (from CIS) report, 456 complaint investigations were actually closed in 
August 2004 (excluding Failures To Qualify, Failures To Appear, and Preventable Traffic 
Collisions). For 324 of these 456 complaint investigations, the complaints were initiated in 
2003 or 2004, and the investigations were completed by IAG and 37 different commands from 
June 2004 through August 2004. If AD had used this population of 324 complaint 
investigations instead of the 113, the calculated sample size would have been 74 instead of 53, 
resulting in 21 additional investigations being evaluated and the possible inclusion of additional 
command investigations in the audit.” Additionally, as confirmed by IAG management and staff, 
higher-risk, more complex complaint investigations that required more time to adjudicate and 
“close” may have been excluded from AD’s audit due to this methodology. 


Thus, it is the OIG’s opinion that AD should have used a population that resulted in a sample 
that included more total complaint investigations (more than 53) from additional commands 
(more than 12) that required more time to adjudicate and close (more than | to 44 days). Audit 
Division management disagreed, indicating the methodology was adequate to assess the 
Department’s compliance with the applicable CD mandates. 


Audit Division reported 100 percent compliance with the mandates of CD {75 (Department’s 
Initiation of a Complaint for Dissuasion, Failure to Inform or Accept Complaints), yet the OIG 
believes that AD should have withheld a determination of compliance. As AD’s review of the 
53 investigations did not identify any indications of officers attempting to thwart the complaint 
process, there was no basis for evaluating the Department’s handling of this type of conduct. 





? Audit Division’s sample size calculation was based on a population of 113, a confidence level of 95 percent (one-tail), 
an expected error rate of six percent, and a plus-precision of four percent. 
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OFFICE OF THE INSPECTOR GENERAL 
REVIEW OF AUDIT DIVISION’S 
COMPLAINT, FORM 1.28, INVESTIGATIONS PHASE 2 AUDIT 
(FISCAL YEAR 2004/2005) 


PURPOSE 


Pursuant to Consent Decree (CD) Paragraph (J) 135, the Office of the Inspector General (OIG) 
reviewed Audit Division’s (AD) Complaint, Form 1.28, Investigations Phase 2 Audit. The audit 
was completed in the third quarter of Fiscal Year (FY) 2004/2005 and received by the OIG on 
March 31, 2005. The OIG assessed the audit’s completeness, findings and quality. 


BACKGROUND ON AD’s AUDIT 


Audit Division reviewed the investigations of 53 complaints represented by AD as closed in 
August 2004. Of the 53 complaints, 33 were investigated by Internal Affairs Group (IAG) and 
20 were investigated by the involved officers’ Chain of Command (COC). The audit evaluated 
the conduct and adjudication of the investigations, the identification and addressing of 
misconduct, and other areas. 


Audit Division reported compliance percentages of at least 95 percent for the following CD 
paragraphs and subparagraphs: 


TABLE No. 1- CD PARAGRAPHS WTH REPORTED COMPLIANCE PERCENTAGES OF AT LEAST 95% 
SUBJ ECT & COMPLIANCE PERCENTAGE 


g 





CONDUCT OF INVESTIGATIONS 





TAPE-RECORDED INTERVIEWS (97°) 





CONVENIENCE OF INTERVIEWS (100°) 





No Group INTERVIEWS (100%) 





PRBS 


INTERVIEWS OF SUPERVISORS AT SCENE OF INCIDENT (100% 





& 


CANVASSING OF THE SCENE (90%) 
COLLECT AND PRESERVE EVIDENCE (97°) 
BURDEN OF EVIDENCE (100°) 


2RR 
Blo 





REASONABLE EFFORTS TO INVESTIGATE VWITHDRAWN AND ANONYMOUS COMPLAINTS (1007/9) 





COMPLETENESS OF THE INVESTIGATIVE FILE (100%) 





OVERALL ADEQUACY OF THE INVESTIGATION (100°) 





ADJ UDICATION OF INVESTIGATIONS 





\MTNESS CREDIBILITY ASSESSMENT (100°) 





No AUTOMATIC PREFERENCE OF OFFICER STATEMENTS (97°) 





No AUTOMATIC J UDGMENT OF INSUFFICIENT INFORMATION (100% 
PREPONDERANCE OF EVIDENCE USEDTO ADJ UDICATE THE COMPLAINT (96%) 
AD UDICATION OF ALL ALLEGATIONS (100%) 





MANAGERS EVALUATE COMPLAINT INVESTIGATIONS FOR UNDERLYING PROBLEMS AND TRAINING NEEDS (100% 





QISRR SSS Bibs 


PROPER NOTIFICATIONS TO THE COMPLAINANT (100°) 





IDENTIFICATION & ADDRESSING OF MSCONDUCT 





INITIATION OF A COMPLAINT FOR DISSUASION, FAILURE TO INFORM OR ACCEPT COMPLAINTS (100° 





Blo 


REFERRAL FOR CRIMINAL FILING WHEN CRIMINAL CONDUCT IS IDENTIFIED (100% 





OTHER 





NO INDICATIONS THAT THE COMPLAINANT WAS ASKED TO WAIVE HIS/HER RIGHT TO A LAWSUIT (100°) 
NOTIFICATION OF ACCUSED DEPARTMENT EMPLOYEE AND HIS/HER SUPERVISOR WHEN REQUIRED (98°) 











RES 


ARTICULATION OF THE LEGAL BASIS FOR STOP (100%) 
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Conversely, AD reported compliance percentages less than 95 percent for the following CD 
paragraphs and subparagraphs: 


TABLE No, 2 - CD PARAGRAPHS WTH REPORTED COMPLIANCE PERCENTAGES LESS THAN 95% 


























(o>) || SUBJ ECT COMPLIANCE PERCENTAGE 
82 INITIATION OF COMPLAINT FOR ADDITIONAL MISCONDUCT 672 OF 3 INVESTIGATIONS) 
129c | GENERAL CONSISTENCY OF PARAPHRASED STATEMENTS 91%(42 OF 46 INVESTIGATIONS) 
80F(b) | ALL WITNESSES INTERVIEWED 887%(43 OF 49 INVESTIGATIONS) 
AD NO INDICATIONS OF DISMSSAL OF WITNESS STATEMENTS SOLELY ON THE 98%(13 OF 14 INVESTIGATIONS) 

BASIS OF FAMLIAL OR SOCIAL RELATIONSHIP TO THE COMPLAINANT 
80G IDENTIFICATION OF INCONSISTENCIES IN OFFICER AND WITNESS STATEMENTS 9P4(15 OF 16 INVESTIGATIONS) 


Greater detail on AD’s methodology and findings can be found in their final audit report. 


BACKGROUND ON THE OIG’s AUDIT SECTION 


As previously reported, the OIG hired a third Assistant Inspector General (AIG) and a Police 
Performance Auditor IV (PPA IV) in March and May 2005, respectively. Both the AIG and the 
PPA IV were assigned to AD prior to accepting their positions with the OIG. Normally, the AIG 
and the PPA IV would refrain from conducting reviews of AD audits for a certain period of time; 
however, as the CD requires the OIG to conduct these reviews, that luxury is not available. 
Nonetheless, the AIG and PPA IV have refrained from conducting or supervising any reviews of 
AD audits that they actively participated on while assigned to AD.' 


PRIOR RECOMMENDATIONS 


The OIG’s prior review of AD’s Complaint, Form 1.28, Investigations Audit for FY 2003/2004 
recommended that an audit related to audio tapes used in Use of Force and Complaint 
Investigations be expanded to evaluate the bookings of both personal cassette recordings and 
Department-issued cassette recordings at Scientific Investigation Division. 


Status - Implemented. Per Civil Rights Integrity Division management, the audit “Audio Tapes 
Used in Non-Categorical Use of Force and Complaint Investigations” was completed in late 
2004. The methodology called for the review of all tapes used in these investigations, including 
personal tapes. Although none of the sampled investigations reported the use of personal tapes, 
that is not unusual. Generally, Department tapes with pre-printed identification numbers are 
used in administrative investigations. 





' Neither the AIG nor the PPA IV participated on the Complaint, Form 1.28, Investigations Phase 2 Audit while they 
were assigned to AD. 
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REVIEW METHODOLOGY 


The OIG assessed the completeness, findings, and quality of AD’s Complaint, Form 1.28, 
Investigations Phase 2 Audit, reviewing the final audit report, related audit plan, and supporting 
work papers.” 


On June 29, 2005, the OIG met with AD management to discuss the results of this review. At 
that time, AD management indicated general agreement with this review’s findings, except for 
the issues mentioned in the Audit Quality section of this report (see page 6). 


REVIEW RESULTS 
COMPLETENESS 


To assess the audit’s completeness, the OIG reviewed the audit to ensure CD mandates were 
addressed and that the audit used a complete population to select its samples. 


Consent Decree Mandates Addressed 


Per the Department’ s Annual Audit Plan (AAP) Status Report — Second Quarter FY 2004/2005, 
AD’s Complaint, Form 1.28, Investigations Phase 2 Audit was to meet the audit requirements 
specified in CD { 129 and assess the following CD paragraphs and subparagraphs: 


Conduct of Investigations (CD {[s 80a, 80b, 80c, 80e, 80f, 80g, 86, 129b, 129c & 129d); 
Adjudication of Investigations (CD {[s 84, 85, 90 & 91); 

Identification and Addressing of Misconduct (CD {s 75, 77&78°, 82 & 101); and, 
Other (CD Js 74h, 80d & 102). 


The OIG determined the audit sufficiently met the audit requirements specified in CD { 129 and 
addressed the aforementioned CD paragraphs and subparagraphs. However, the OIG identified 
an issue with AD’s assessment of CD fs 75 (see page 6). 


Identification of a Complete Population 


Audit Division selected its sample from complaints for which investigations were completed 
from August 1 to 31 of 2004 and “closed” (fully adjudicated and entered into the Complaint 
Information System) from August 1 to September 14 of 2004. Audit Division correctly 
identified 113 complaint investigations after excluding all complaints pertaining to failures to 
qualify (FTQs), failures to appear in court (FTAs), and preventable traffic collisions (PTCs). 





? The OIG’s review of supporting work papers was based on a randomly selected one-tail sample size calculation 
with a 95 percent confidence level, an expected error rate of six percent, and a plus-precision of seven percent. 

? There was no basis for evaluating {77 (Self-Reporting of Arrest) and {| 78 (Initiation of Complaint for 
Misconduct), so AD withheld a conclusion for these two paragraphs. 
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The OIG agreed with the exclusion due to the lower risks associated with those types of 
investigations. Thus, the population that AD used to select its sample was complete per the 
methodology that they established. However, as discussed in the Audit Quality section of this 
report, the sampling methodology AD used was not accurately articulated in AD’s report and the 
methodology impacted the audit’s quality (see page 6). 


Conclusion 


Overall, the OIG determined the audit addressed applicable CD mandates. Additionally, the 
population that AD used was complete per the methodology established by AD. 


FINDINGS 


To assess the audit’s findings, the OIG reviewed AD’s supporting work papers to ensure there 
was adequate support for findings and reviewed the report to ensure the findings were properly 
presented. 


Support for Findings 


From AD’s sample of 53 complaints, the OIG selected and reviewed a “sub-sample” of 26 
complaints, including 16 investigated by IAG and 10 investigated by COC.* The OIG agreed 
with nearly all of AD’s assessments related to the complaint investigations, but disagreed with 
two assessments that affected AD’s reported compliance percentages for the following two CD 
paragraphs and subparagraphs. 


TABLE No. 3 - TWO ADDITIONAL ANOMALIES NOTED BY THE OIG 




















AD'S REPORTED OIG’S AD USTED 
Be ENS Nea COMPLIANCE PERCENTAGE | COMPLIANCE PERCENTAGE 
129c GENERAL CONSISTENCY OF PARAPHRASED g1% 8% 
STATEMENTS (Note 1) (42 OF 46 INVESTIGATIONS) (41 OF 46 INVESTIGATIONS) 
100% 8% 
9L PROPER NOTIFICATION TO THE COMPLAINANT (Note 2) (45 OF 45 INVESTIGATIONS) (44.0 45 INVESTIGATIONS) 








Note 1: For CF No. 03-2999, the paraphrased statement of the complainant states: "Complainant 
further advised that her neighbor (in Apt. No. 1) told her that he heard her deny consent to search 
her apartment. This neighbor later heard one of the officers say that the complainant gave them 
consent to search." However, the investigator’s Chronological Record indicates that the 
neighbor did not submit to an interview, so it is unknown where the second underlined sentence, 
apparently attributed to this neighbor, came from. Furthermore, the related tape of this interview 
could not be located (which was noted by AD in the Other Matters section of their report). 





* After reviewing the 26 complaint investigations, the OIG discovered that the listing provided by AD erroneously 
included one complaint that AD deselected and omitted another complaint that AD evaluated. As a result, the OIG 
did not have the opportunity to randomly select CF No. 03-3872. 
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While the OIG understands, as AD noted, that an independent witness (in Apt. No. 6) and 
Departmental witnesses stated that they heard the complainant give consent to the search, 
paraphrased statements used to adjudicate complaints should be accurate and supported. 


Additionally, the OIG noted that the canvassing of apartments next to the complainant’s 
apartment occurred almost 11 months after the incident. 


Note 2: For CF No. 04-1721, AD concluded that the final Notification Letter sent to the 
complainant included the investigation’s significant dates, general allegations, and disposition 
(as required by CD { 91). However, the Notification Letter sent to the complainant identified the 
general allegation as "False Statements" instead of "False Arrest." The OIG believes that the 
Notification Letter, as written, could give the complainant or other reader (who is not provided 
the complete detailed investigative report) the false impression that the Department did not 
understand and address the complainant’s allegation. Audit Division disagreed that this was a 
CD { 91 anomaly, stating that it was a minor administrative error. 


Presentation of Findings 


The presentation of the audit’s findings was well organized and the narrative of the report 
supported all calculations. However, the OIG noted the following two issues: 


e The audit report shows overall CD paragraph compliance percentages, but to provide more 
useful information to the reader of the report, compliance percentages could have also been 
presented for each of the two strata: IAG investigated complaints and COC investigated 
complaints. 


e Regarding CD { 91 “Notification of the Complainant,” the audit report states that AD did not 
review a Notification Letter for one complaint investigation due to its confidentiality. The 
OIG believes that this Notification Letter should have been reviewed by AD. 

Conclusion 

Overall, AD’s supporting work papers adequately supported the findings, and the findings were 


properly presented in the report. Although a few issues were identified, the issues did not rise to 
the level of a significant deficiency. 


(THIS SECTION WAS INTENTIONALLY LEFT BLANK) 
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QUALITY 
The OIG evaluated AD’s audit and report for quality. 
Audit Quality 


The audit was properly supervised and, although many aspects of the audit methodology were 
appropriate, the OIG identified two significant issues related to the audit’s sampling 
methodology and the audit evidence used to evaluate CD { 75, further described below. 


e Audit Division used a sampling methodology that resulted in a relatively small sample of 
complaint investigations being evaluated. Audit Division reported that its sample was 
selected from a population of complaint investigations closed in August 2004. However, its 
sample was actually selected from a population of 113 complaint investigations that were 
completed from August 1 to 31 of 2004 and “closed” (fully adjudicated and entered into the 
Complaint Information System [CIS]) from August 1 to September 14 of 2004. The 
population included investigations from 17 commands; and AD’s sample included 20 COC 
investigations from only 12 commands. 


Based on a query (from CIS) report, 456 complaint investigations were actually closed in 
August 2004 (excluding FTQs, FTAs and PTCs). For 324 of these 456 complaint 
investigations, the complaints were initiated in 2003 or 2004, and the investigations were 
completed by IAG and 37 different commands from June 2004 through August 2004. If AD 
had used this population of 324 complaint investigations instead of the 113, the calculated 
sample size would have been 74 instead of 53, resulting in 21 additional investigations being 
evaluated and the possible inclusion of additional command investigations in the audit.° 
Additionally, as confirmed by IAG management and staff, higher-risk, more complex 
complaint investigations that required more time to adjudicate and “close” may have been 
excluded from AD’s audit due to this methodology. 


Thus, it is the OIG’s opinion that AD should have used a population that resulted in a sample 
that included more total complaint investigations (more than 53) from additional commands 
(more than 12) that required more time to adjudicate and close (more than 1 to 44 days). 
Audit Division management disagreed, indicating the methodology was adequate to assess 
the Department’s compliance with the applicable CD mandates. 


e Audit Division reported 100 percent compliance with the mandates of CD {[ 75 
(Department’s Initiation of a Complaint for Dissuasion, Failure to Inform or Accept 
Complaints), yet the OIG believes that AD should have withheld a determination of 
compliance. As AD’s review of the 53 investigations did not identify any indications of 





` Audit Division’s sample size calculation was based on a population of 113, a confidence level of 95 percent (one- 
tail), an expected error rate of six percent, and a plus-precision of four percent. 
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officers attempting to thwart the complaint process, there was no basis for evaluating the 
Department’s handling of this type of conduct. 


Report Quality 


The report delineated the audit’s objectives, scope, and methodology. Also, the report was 
issued in a timely manner (within a year of AD’s last audit), used a fair and unbiased tone, and 
was convincing and concise. However, the OIG noted the following two issues: 


e Audit Division was unable to schedule an exit conference with IAG management to obtain 
their views regarding AD’s reported findings and recommendations, and this matter was not 
noted in AD’s report. 


e Audit Division did not report on the status of two recommendations made in its prior audit 
report for FY 2003/2004. At that time, AD recommended that investigators/interviewers 
state that “a group interview was not conducted” at the beginning of a taped interview 
(current status - in progress), and that Professional Standard Bureau notify IAG and COC of 
approaching five-month due dates for open investigations (current status - implemented). 
Instead of addressing these two issues, AD used this section of its report to discuss recurring 
issues noted by both AD and the Federal Monitor in recent audits. 


Conclusion 


Overall, the audit was properly supervised and reported in a quality manner. Although many 
aspects of the audit methodology were appropriate, the OIG believes AD used an improper 
methodology to identify and sample complaint investigations. This raises the question of 
whether AD’s reported compliance percentages are truly representative for the Department as a 
whole. 


